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Motivation  for  Topic 


Team  Charter 


•  DOD  issued  55  years  ago 
MIL-Q-9858Aand  MIL-I-45208A 

-  Emphasis  on  complete  and 
frequent  visual  inspection 

•  Technology  has  improved  since 
then 

-  Process  controls 

-  Product  quality 

-  Inspection  capabilities 

•  Inspection  change  versus  risk 
guidance  is  lacking 


•  Develop  a  tool  for  determining  if 
a  change  in  inspection  approach 
is  warranted 

-  Review  industry  data  and 
feedback  from  DCMA  to 
identify  candidate  processes 

-  Identify  best  practices  for 
optimal  quality  inspection 
planning  and  deployment 

-  Evaluate  candidate  processes 
using  new  tool 
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Decision  Tree 


Example 

ICT  via  Flying  Probe 

•  Shift  inspection  of 
PWB  from  manual 
inspection  to  flying 
head  automated  probe 

-  False  errors  manual 
inspection  reduced 

-  Time  study  of  the 
same  board  shows 
significant  time 
reduction 

-  Output  of  machine  lists 
part  non-conformities 

-  Manual  Inspection 
covers  10-20%  of  parts 
not  covered  by  the 
machine 
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In-Circuit  Test  via  Flying  Head  Probe 
Analyses  Performed 


Critical  Process 


•  Reviewed  historical 
inspection  process 
output 

•  Reviewed  customer 
requirements 

•  Identified  potential  tool 
suppliers 

•  Performed  risk 
analysis  against 
existing  processes 

•  Study  of  cost  vs. 
CAPEX  vs.  inspection 
performance 
completed 


Conduct  effectiveness 
study 


Improve  inspection  or 
reduce/eliminate 


Maintain  inspection 


Produce  capable  process 


Process  Capability 


•  Reviewed  supplier  tool 
sets 

•  Performed  bench  test 
using  EDU  boards 

•  Verified  results  against 
existing  inspection 
method 

•  Identified  process 
accuracy  and 
repeatability  issues 

•  Compared  results  to 
risk  and  cost  analyses 
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In-Circuit  Test  via  Flying  Head  Probe 
Analyses  Performed 


Conduct  effectiveness 
study 

Improve  inspection  or 
reduce/eliminate 
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Effective 

Inspection 


Test  board  coverage 
and  issues  reviewed 

Identified 

requirements  against 
typical  part  usage 
Identified  part  types 
and  applications 
where  ICT  not  able  to 
capture  all  issues 


Performed  study  for 
purchasing  unit  vs. 
outsourcing 

Identified  multiple 
suppliers  and 
reviewed  capabilities 
against  requirements 


U.S.  SPACE  PROGRAM  MISSION  ASSURANCE  IMPROVEMENT  WORKSHOP 
LOCKHEED-MARTIN  |  SUNNYVALE,  CA  |  MAY  5  -  7,  2015 


Analysis  Results  into  Tool 


Analysis  Category 

Entries  in  tool 

Manufacturing 
Process  Change 

Inspection 
Process  Change 

Data  Driven  Insp. 
Change 

Manufacturing 

Lines  1-5 

40% 

22% 

22% 

Inspection 

Lines  6-8 

30% 

45% 

38% 

Cost  and 
Customer 

Lines  9-10 

30% 

33% 

40% 

100% 


Cd 

Z> 


50% 


0% 


JUST  DO  IT 

QUADRANT 

STRATEGIC 

QUADRANT 

BACKLOG 

QUADRANT 

FORGET  IT 

QUADRANT 

LOW 


HIGH 


Strategic 


100% 


CO 

LU 

> 

—  50 % 


cd 

D 


0% 


0% 


50% 

INVESTMENT 


100% 


0% 


50% 


100% 
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Tool  Design 


Analyses 


Return 


Investment 


1.  Do  the  results  of  a  PFMEA  show 
potential  for  improved  quality? 

2.  Is  the  process  qualified  and 
capable? 

3.  Does  the  first  article  indicate  less 
inspection  is  required? 

4.  Does  the  current  process  have  a  low 
level  of  nonconformities? 

5.  Does  the  proposed  process  output 
rate  affect  inspection  capabilities? 

6.  Was  a  gage  R&R  performed  with 
personnel  performing  the  inspection 
function? 

7.  Will  the  improved  inspector  process 
increase  the  ability  to  find 
nonconformities? 

8.  Will  the  process  change  reduce 
inspector  escapes? 

9.  Has  a  cost  analysis  been  performed 
(p<k1/k2,  see  Appendix  B)? 

10.  Will  the  customer  allow  the  change? 


c 

o 

CD 

O 


C/) 


Weight 

Manufacturing 

Process 

Change 

Inspection 

Process 

Change 

Management  or 
Customer  Input 


1.  Does  not  justify 
removal  of 
inspection 
process 

2.  Additional  data 
required  before 
decision  can  be 
made 

3.  Data  Justifies 
capabilities  study 
for  process 
modification 

4.  Justifies 
modification  of 
inspection 
process 

5.  Justifies  removal 
of  inspection 
process 


1 .  Low  Effort  (Easy 
or  completed, 
limited 

personnel,  <3 
months) 

2.  Between  Low 
and  Medium 

3.  Medium  Effort 
(Hurdles, 
somewhat 
difficult,  >6 
months) 

4.  Between 
Medium  and 
High 

5.  High  Effort 
(Complex,  lots  of 
people,  >1  yr) 


Fixed  by  Tool 


User  Modifiable 


User  Modifiable 


User  Modifiable 
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RETURN  ON  INVESTMENT 


Additional  Examples  in  Product 


Torque  Witness  by  Inspection  Personnel 


Test  to  flight  (class  2)  electrical  mates 


Forget  It 

100% 


50% 


0% 

0%  50%  100% 

INVESTMENT 

Evaluating  whether  or  not  to  eliminate 
Inspection  witness  of  "Torque"  operations 


Just  Do  It 


INVESTMENT 


Elimination  of  a  secondary  inspection 
(by  QA)  for  test  to  flight  connector  mates 
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RETURN  ON  INVESTMENT 


Additional  Examples  in  Product 


Receiving  Inspection  of  subcontracted 
products  (QSI-1002) 

Backlog 


INVESTMENT 


Examples  of  Each  Potential  Outcome 


100% 


CL 

3 


50% 


0% 


JUST  DO  IT  # 
QUADRANT 

• 

STRATEGIC 

QUADRANT 

• 

BACKLOG 

QUADRANT 

• 

FORGET  IT 
QUADRANT 

LOW 


HIGH 


Evaluating  reduction  in  duplicative 
inspection  efforts  upon  receipt  for  items 
that  are  Final  Source  Inspected 


0%  50%  100% 

INVESTMENT 


* 

Wv 
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Target  Audience  and  Intended  Product  Use 


•  Target  Audience 

-  Quality  organizations  looking  for  efficiencies 

-  Manufacturing  organizations  pursuing  new  technology 

-  Stakeholders  seeking  ways  to  reduce  non-value  added  costs 

•  How  Used 

-  Best  applied  early  in  change  evaluation  decision 

-  Useful  when  many  trades  are  possible 

•  Provides  best  indication  of  tradeoffs  resulting  from  a  proposed 
process  change 
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Quality  Deployment  Team  Membership 

Core  Team  SME  Team 
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Fouie  Fombardo 

Fockheed  Martin 

louie .  lombardo@lmco  .com 

Kurt  Ketola 

Raytheon 

ketola@raytheon.com 

Debbie  Schreiber 

Fockheed  Martin 
debbie.schreiber@lmco.com 

Rob  Fyon 

SSF 

robert.lyon@sslmda.com 

Ronand  Mandel 
Lockheed  Martin 
ronald.h.mandel@lmco.com 


Patrick  Martin 
NASA 

partick.martin@nasa.gov 


Steven  McNeil 
Xilinx 

stevem@xilinx.com 


Kevin  Meadows 
Northrop  Grumman 
kevin.meadows@ngc.com 


Eli  Minson 
Ball 

eminson@ball .  com 


Tom  Musselman 
Boeing 

thomas.e.musselman@boeing.com 


Helen  Narciso 
Lockheed  Martin 
helen.narciso@lmco.com 


John  Nelson 
Lockheed  Martin 
john.d.nelson@lmco.com 


David  Newton 
Northrop  Grumman 
david.a.newton@ngc.com 


Ethan  Nguyen 
Raytheon 

ethan_m_nguyen@raytheon.com 


Jeff  Oberst 
Lockheed  Martin 
j  eff.  ober  st@lmco .  com 


Frank  Pastizzo 
SSL 

frank.pastizzo@sslmda.com 


Kevin  Paxton 
Boeing 

kevin.r.paxton@boeing.com 


David  Pinkley 
Ball 

dpinkley  @ball .  com 


Rob  Pollard 
Ball 

rpollard@ball .  com 


Anne  Ramsey 
Harris 

aramsey  @harris .  com 


Brian  Reilly 
DCMA 

Brian.Reilly@dmca.mil 


Robert  Ricco 
Northrop  Grumman 
bob.ricco@ngc.com 


John  Robinson 

Aerojet  Rocketdyne 

john.robinson@rocket.com 


Frank  Roller 
Lockheed  Martin 
frank.d.roller@lmco.com 


Joseph  Roubal 

Aeroflex,  a  Cobham  Company 
joseph.roubal@aeroflex.com 


Rabindra  Singh 
SSL 

Rob.Singh@sslmda.com 


Melanie  Sloane 
Lockheed  Martin 
melanie .  sloane@lmco  .com 


Homer  D.  Stevens 
Lockheed  Martin 
homer.d.stevens@lmco.com 


Norman  Strampach 

Lockheed  Martin 

norman.  strampach@lmco .  com 


David  Swanson 
Orbital  ATK 

David.Swanson@orbitalatk.com 


Alfred  Tadros 
SSL 

Alfred.  T  adros@sslmda.  com 


Jeffrey  Tate 
Raytheon 

j  effrey_tate@raytheon.  com 


Paul  Thompson 
Intelsat 

PaulAlex.Thompson@intelsat.com 


Brett  Tobey 
Lockheed  Martin 
brett.f.tobey@lmco.com 


Mike  Tolmasoff 

Boeing 

mike.w.tolmasoff@boeing.com 

Lance  Werthman 

Lockheed  Martin 
lance.werthman@lmco.com 

Brig  Gen  Anthony  Cotton 

NRO 

cottonan@nro .  mil 

Ghislain  Turgeon 

SSL 

Ghislain.Turgeon@sslmda.com 

Dan  Yasukawa 

Lockheed  Martin 
dan.yasukawa@lmco.com 

Kevin  Craig 

SSL 

kevin.craig@sslmda.com 

Deborah  Valley 

MIT  Lincoln  Labs 
deborah.valley@ll.mit.edu 

Thomas  Fitzgerald 

SMC 

thomas .  fitzgerald.  5  @us .  as .  mil 

Thomas  Reinsel 

Raytheon 

thomasj_reinsel@raytheon.com 

Richard  Veres 

Honeywell 

richard.veres@honewell.com 

Hal  Bell 

NASA 

harold.m.bell@nasa.gov 

Michael  Phelan 

DCMA 

michael.phelan@dcma.mil 

Brynn  Watson 

Lockheed  Martin 
brynn.a.watson@lmco.com 

Mike  Wadzinski 

MDA 

mike.wadzinski@mda.mil 

APPROVED  BY 

DATE 
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